33 research outputs found
On Balancing Event and Area Coverage in Mobile Sensor Networks
In practice, the mobile sensor networks have two important tasks: firstly, sensors should be able to locate themselves close to where major events are happening so that event tracking becomes possible; secondly, the sensor networks should also maintain a good area coverage over the environment in order to detect new events. Because these two tasks are usually conflicting with each other, a coverage control policy should be able to balance the event and area coverage of the environment. However, most existing work is to achieve either optimal event coverage or optimal area coverage over the environment. In this thesis, a Voronoi-based coverage control with task assignment is introduced: each sensor is allowed to switch between event and area coverage depending on the intensity of events within its Voronoi cell, and both continuous-time and discrete-time control for sensor positions are discussed
Learning Coherent Clusters in Weakly-Connected Network Systems
We propose a structure-preserving model-reduction methodology for large-scale
dynamic networks with tightly-connected components. First, the coherent groups
are identified by a spectral clustering algorithm on the graph Laplacian matrix
that models the network feedback. Then, a reduced network is built, where each
node represents the aggregate dynamics of each coherent group, and the reduced
network captures the dynamic coupling between the groups. We provide an upper
bound on the approximation error when the network graph is randomly generated
from a weight stochastic block model. Finally, numerical experiments align with
and validate our theoretical findings.Comment: arXiv admin note: text overlap with arXiv:2209.1370
Early Neuron Alignment in Two-layer ReLU Networks with Small Initialization
This paper studies the problem of training a two-layer ReLU network for
binary classification using gradient flow with small initialization. We
consider a training dataset with well-separated input vectors: Any pair of
input data with the same label are positively correlated, and any pair with
different labels are negatively correlated. Our analysis shows that, during the
early phase of training, neurons in the first layer try to align with either
the positive data or the negative data, depending on its corresponding weight
on the second layer. A careful analysis of the neurons' directional dynamics
allows us to provide an upper bound on
the time it takes for all neurons to achieve good alignment with the input
data, where is the number of data points and measures how well the
data are separated. After the early alignment phase, the loss converges to zero
at a rate, and the weight matrix on the first layer
is approximately low-rank. Numerical experiments on the MNIST dataset
illustrate our theoretical findings
Exploiting Structural Properties in the Analysis of High-dimensional Dynamical Systems
The physical and cyber domains with which we interact are filled with high-dimensional dynamical systems. In machine learning, for instance, the evolution of overparametrized neural networks can be seen as a dynamical system. In networked systems, numerous agents or nodes dynamically interact with each other. A deep understanding of these systems can enable us to predict their behavior, identify potential pitfalls, and devise effective solutions for optimal outcomes. In this dissertation, we will discuss two classes of high-dimensional dynamical systems with specific structural properties that aid in understanding their dynamic behavior.
In the first scenario, we consider the training dynamics of multi-layer neural networks. The high dimensionality comes from overparametrization: a typical network has a large depth and hidden layer width. We are interested in the following question regarding convergence: Do network weights converge to an equilibrium point corresponding to a global minimum of our training loss, and how fast is the convergence rate? The key to those questions is the symmetry of the weights, a critical property induced by the multi-layer architecture. Such symmetry leads to a set of time-invariant quantities, called weight imbalance, that restrict the training trajectory to a low-dimensional manifold defined by the weight initialization. A tailored convergence analysis is developed over this low-dimensional manifold, showing improved rate bounds for several multi-layer network models studied in the literature, leading to novel characterizations of the effect of weight imbalance on the convergence rate.
In the second scenario, we consider large-scale networked systems with multiple weakly-connected groups. Such a multi-cluster structure leads to a time-scale separation between the fast intra-group interaction due to high intra-group connectivity, and the slow inter-group oscillation, due to the weak inter-group connection. We develop a novel frequency-domain network coherence analysis that captures both the coherent behavior within each group, and the dynamical interaction between groups, leading to a structure-preserving model-reduction methodology for large-scale dynamic networks with multiple clusters under general node dynamics assumptions
A Frequency Domain Analysis of Slow Coherency in Networked Systems
Network coherence generally refers to the emergence of simple aggregated
dynamical behaviours, despite heterogeneity in the dynamics of the subsystems
that constitute the network. In this paper, we develop a general frequency
domain framework to analyze and quantify the level of network coherence that a
system exhibits by relating coherence with a low-rank property of the system's
input-output response. More precisely, for a networked system with linear
dynamics and coupling, we show that, as the network's \emph{effective algebraic
connectivity} grows, the system transfer matrix converges to a rank-one
transfer matrix representing the coherent behavior. Interestingly, the non-zero
eigenvalue of such a rank-one matrix is given by the harmonic mean of
individual nodal dynamics, and we refer to it as the coherent dynamics. Our
analysis unveils the frequency-dependent nature of coherence and a non-trivial
interplay between dynamics and network topology. We further show that many
networked systems can exhibit similar coherent behavior by establishing a
concentration result in a setting with randomly chosen individual nodal
dynamics.Comment: arXiv admin note: substantial text overlap with arXiv:2101.0098
Voronoi-Based Coverage Control of Pan/Tilt/Zoom Camera Networks
A challenge of pan/tilt/zoom (PTZ) camera networks for efficient and flexible visual monitoring is automated active network reconfiguration in response to environmental stimuli. In this paper, given an event/activity distribution over a convex environment, we propose a new provably correct reactive coverage control algorithm for PTZ camera networks that continuously (re)configures camera orientations and zoom levels (i.e., angles of view) in order to locally maximize their total coverage quality. Our construction is based on careful modeling of visual sensing quality that is consistent with the physical nature of cameras, and we introduce a new notion of conic Voronoi diagrams, based on our sensing quality measures, to solve the camera network allocation problem: that is, to determine where each camera should focus in its field of view given all the other cameras\u27 configurations. Accordingly, we design simple greedy gradient algorithms for both continuous- and discrete-time first-order PTZ camera dynamics that asymptotically converge a locally optimal coverage configuration. Finally, we provide numerical and experimental evidence demonstrating the effectiveness of the proposed coverage algorithms
Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019
Background: In an era of shifting global agendas and expanded emphasis on non-communicable diseases and injuries along with communicable diseases, sound evidence on trends by cause at the national level is essential. The Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) provides a systematic scientific assessment of published, publicly available, and contributed data on incidence, prevalence, and mortality for a mutually exclusive and collectively exhaustive list of diseases and injuries. Methods: GBD estimates incidence, prevalence, mortality, years of life lost (YLLs), years lived with disability (YLDs), and disability-adjusted life-years (DALYs) due to 369 diseases and injuries, for two sexes, and for 204 countries and territories. Input data were extracted from censuses, household surveys, civil registration and vital statistics, disease registries, health service use, air pollution monitors, satellite imaging, disease notifications, and other sources. Cause-specific death rates and cause fractions were calculated using the Cause of Death Ensemble model and spatiotemporal Gaussian process regression. Cause-specific deaths were adjusted to match the total all-cause deaths calculated as part of the GBD population, fertility, and mortality estimates. Deaths were multiplied by standard life expectancy at each age to calculate YLLs. A Bayesian meta-regression modelling tool, DisMod-MR 2.1, was used to ensure consistency between incidence, prevalence, remission, excess mortality, and cause-specific mortality for most causes. Prevalence estimates were multiplied by disability weights for mutually exclusive sequelae of diseases and injuries to calculate YLDs. We considered results in the context of the Socio-demographic Index (SDI), a composite indicator of income per capita, years of schooling, and fertility rate in females younger than 25 years. Uncertainty intervals (UIs) were generated for every metric using the 25th and 975th ordered 1000 draw values of the posterior distribution. Findings: Global health has steadily improved over the past 30 years as measured by age-standardised DALY rates. After taking into account population growth and ageing, the absolute number of DALYs has remained stable. Since 2010, the pace of decline in global age-standardised DALY rates has accelerated in age groups younger than 50 years compared with the 1990–2010 time period, with the greatest annualised rate of decline occurring in the 0–9-year age group. Six infectious diseases were among the top ten causes of DALYs in children younger than 10 years in 2019: lower respiratory infections (ranked second), diarrhoeal diseases (third), malaria (fifth), meningitis (sixth), whooping cough (ninth), and sexually transmitted infections (which, in this age group, is fully accounted for by congenital syphilis; ranked tenth). In adolescents aged 10–24 years, three injury causes were among the top causes of DALYs: road injuries (ranked first), self-harm (third), and interpersonal violence (fifth). Five of the causes that were in the top ten for ages 10–24 years were also in the top ten in the 25–49-year age group: road injuries (ranked first), HIV/AIDS (second), low back pain (fourth), headache disorders (fifth), and depressive disorders (sixth). In 2019, ischaemic heart disease and stroke were the top-ranked causes of DALYs in both the 50–74-year and 75-years-and-older age groups. Since 1990, there has been a marked shift towards a greater proportion of burden due to YLDs from non-communicable diseases and injuries. In 2019, there were 11 countries where non-communicable disease and injury YLDs constituted more than half of all disease burden. Decreases in age-standardised DALY rates have accelerated over the past decade in countries at the lower end of the SDI range, while improvements have started to stagnate or even reverse in countries with higher SDI. Interpretation: As disability becomes an increasingly large component of disease burden and a larger component of health expenditure, greater research and developm nt investment is needed to identify new, more effective intervention strategies. With a rapidly ageing global population, the demands on health services to deal with disabling outcomes, which increase with age, will require policy makers to anticipate these changes. The mix of universal and more geographically specific influences on health reinforces the need for regular reporting on population health in detail and by underlying cause to help decision makers to identify success stories of disease control to emulate, as well as opportunities to improve. Funding: Bill & Melinda Gates Foundation. © 2020 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 licens